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DESCRIPTION 



METHODS OF USE OF IPMP DATA FOR MPEG-n IPMP (INTELLECTUAL 
PROPERTY MANAGEMENT AND PROTECTION) 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to content distribution and protection, 
especially to such applications where the protected content based on MPEG-n is 
consumed by different IPMP terminals, and the same content is protected by 
different IPMP tools. 

DESCRIPTION OF THE BACKGROUND ART 

Content distribution is becoming more and more demanding as 
multimedia data and contents can reach anywhere and anytime. Users are 
happy with the convenience and flexibility, and they can enjoy entertainment 
easily and efficiently. On the other hand, content owners are worried about the 
illegal usage of their property. There is a balance between two sides. 

There are a lot of protection techniques for protecting tfie content, such 
as data encryption, watermarking, etc. They have been implemented in many 
content distribution applications. It seems different system employs different 
kinds of mechanisms and protection techniques to distribute content with 
protection. All the terminals or content consuming devices in that case are only 
able to play and consume the content that is provided by the same content 
provider. They cannot exchange their terminal or device to playback different 
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contents. 

In MPEG-n context, a standardisation group has been working on 
MPEG-2,4,7,21 IPMP. The solution is able to achieve both of the following: 

1. Allow the same protected content to be consumed on different vendors* 
5 MPEG-n IPMP Terminals. This will be fully enabled; and 

2. Allow the same content to be protected by different vendors' IPMP Tools. 
This will be assisted to as large extent as possible. 

The prior art of MPEG-n IPMP is illustrated in Fig. 1. 

To achieve such a wide interoperability, IPMP data needs to be 
10 standardized. IPMP data is the data that describes IPMP information, it may 
include time variant key that is carried in IPMP stream, it may also include tool 
initialisation information, or any data that an IPMP tool needs. However, so far, 
the standard of MPEG-2, 4, 7, 21 IPMP has not addressed this issue. 

Without the standardization of IPMP data, a IPMP tool from Vendor A will 
15 not understand the IPMP data constructed by Content Author B, hence the 
inter-operability will not be achieved, that is, the same protected content will not 
be able to be consumed on different vendor's MPEG-n IPMP terminals. 

SUMMARY OF THE INVENTION 
20 To solve the problem, to assure a clear and interoperable standard, the 

IPMP_Data_BaseClass is defined, several IPMP data extending from this base 
class are also defined, which include IPMP opaque data, audio watermarking 
tool initialisation information, video watermarking tool initialisation information, 
IPMP key stream, etc. 

25 In a first aspect of the invention, a method of using IPMP Data in MPEG- 
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2 IPMP system, at the content author side comprises the following steps of: 

Constructing IPMP data extending from IPMP_Data_BaseClass, 
following the defined IPMP data syntax; 

Carry the IPMP data in IPMP Descriptor in IPMP Control Graph 
5 which is subsequently carried in PSI. 

In a second aspect of the invention, a method of using IPMP Data in 
MPEG-2 IPMP system, at the content author side comprises the following steps 
of: 

Constructing IPMP data extending from IPMP_Data_BaseClass, 
10 following the defined IPMP data syntax; 

Carry the IPMP data in IPMP Stream, the IPMP data is wrapped in 
Stream Data Update which has a destination address indicating which tool the 
IPMP data should be sent to. 

In a third aspect of the invention, a method of using IPMP Data in MPEG- 
15 2 IPMP system, at the IPMP terminal side, comprises the following steps of: 

The IPMP terminal extracts the IPMP Descriptor containing the IPMP 
data from the content stream; 

The IPMP terminal delivers the IPMP Descriptor containing the IPMP 
data to the specific tool which is also indicated in IPMP Descriptor by the means 
20 of IPMP Tool ID; 

The IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a fourth aspect of the invention, a method of using IPMP Data in 
MPEG-2 IPMP system, at the IPMP terminal side is proviede. The method 
25 comprises the following steps of: 
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The IPMP terminal demultiplexes the IPMP Stream containing the IPMP 
data from the content stream; 

The IPMP terminal delivers each IPMP_StreamDataUpdate containing 
the IPMP data to the specific tool whose address is indicated in the above 
5 mentioned IP MP_Stream Data Update; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a fifth aspect of the invention, a method of using IPMP Data in MPEG- 
4 IPMP system, at the content author side comprises the following steps of: 
10 Constructing IPMP data extending from IPMP_Data_BaseClass, 

following the defined IPMP data syntax; 

Carry the IPMP data in IPMPJTooLDescriptor in OD stream. 

In a sixth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the content author side, comprises the following 
15 steps of: 

Constructing IPMP data extending from IPMP_DataJ3aseClass, 
following the defined IPMP data syntax; 

Carry the IPMP data in IPMPJnitialize which is subsequently carried in 
IPMPJTooLDescriptor in OD stream. 
20 In a seventh aspect of the invention, a method of using IPMP Data in 

MPEG-4 IPMP system, at the content author side, comprises the following 
steps of: 

Constructing IPMP data extending from IPMP_Data_BaseCIass, 
following the defined IPMP data syntax; 
25 Carry the IPMP data in IPMP Stream, the IPMP data is wrapped in 
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IPMP_StreamDataUpdate which has a destination address indicating which tool 
the IPMP data should be sent to. 

In an eighth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
5 of: 

The IPMP terminal extracts the IPMP_TooLDescriptor containing the 
IPMP data from the content stream; 

The IPMP terminal dielivers the IPMP_Tool_Descriptor containing the 
IPMP data to the specific tool which is also indicated in IPMP_Tool_Descriptor 
10 by the means of IPMP Tool ID in IPMP_Tool_Descriptor; 

The IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a ninth aspect of the invention, a method of using IPMP Data in 
MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
15 of: 

The IPMP terminal extracts the IPMPJnitialize containing the IPMP data 
from the IPMP_Tool_Descriptor from the content stream; 

The IPMP terminal delivers the IPMP_Tool_Descriptor containing the 
above mentioned IPMPJnitialize which subsequently carries IPMP data to the 
20 specific tool which is also indicated by the means of IPMP Tool ID in 
IPMP_Tool_Descriptor; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In a tenth aspect of the invention, a method of using IPMP Data in 
25 MPEG-4 IPMP system, at the IPMP terminal side, comprises the following steps 
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of: 

The IPMP terminal extracts the IPMP_StreamDataUpdate containing the 
IPMP data from the IPMP Stream from the content stream; 

The IPMP terminal delivers the IPMP_StreamDataUpdate containing the 
5 above mentioned IPMP data to the specific tool which is also indicated in 
IPMP_StreamDataUpdate by the means of IPMP_ToolDescriptorlD; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

In an eleventh aspect of the invention, a method of using IPMP Data in 
10 MPEG-n IPMP system, at the content author side, comprises the following 
steps of: 

Constructing IPMP data extending from some IPMP data base class, 
following the defined IPMP data syntax; 

Carry the IPMP data in defined position in the MPEG-n IPMP content 
15 stream; 

In a twelfth aspect of the invention, a method of using IPMP Data in 
MPEG-n IPMP system, at the IPMP terminal side, comprises the following steps 
of: 

The IPMP terminal extracts the IPMP Data from the defined position in 
20 the content stream; 

The IPMP terminal delivers the IPMP Data to the specific tool which is 
also indicated by the means of IPMP Tool ID associated with the IPMP Data; 

The IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 
25 In a thirteenth aspect of the invention, a Method of using IPMP video 
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watermarking tool in MPEG-n IPMP system, at the IPMP terminal side, 
comprises the following steps of: 

The IPMP terminal extracts the IPMP video watermarking initialization 
data from the defined position in the content stream; 
5 The IPMP terminal delivers the IPMP video watermarking initialization 

data to the specific video watermarking tool which is also indicated by the 
means of IPMP Tool ID associated with the IPMP Data; 

The IPMP video watermarking tool, upon receiving of such an IPMP Data, 
interprets it according to the specific IPMP data syntax, and act upon it; 
10 The IPMP video watermarking tool, when detecting a watermark from the 

video stream, notifies the terminal using IPMP_SendVideoWatermark message. 

BRIEF DESCRIPTION OF THE DRAWINGS 

This and other objects and features of the present invention will become 
15 clear from the subsequent description of a preferred embodiment thereof made 
with reference to the accompanying drawings, in which like parts are designated 
by like reference numerals and in which: 

Fig. 1 is a diagram showing IPMP architecture for generic IPMP as the 
prior art; 

20 Fig. 2 is a diagram showing the types of IPMP data extending from 

IPMPJDataBase; 

Fig. 3 is a diagram showing the places to carry IPMP data in MPEG-2 
IPMP content; and 

Fig. 4 is a diagram showing how MPEG-2 IPMP terminal processes 
25 IPMP protected MPEG-2 content using IPMP data. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 2 illustrates the defined IPMP data extending from 
IPMP_Data_BaseClass. Places where IPMP data extending from 
5 IPMPJData_BaseClass are also specified. 

IPMPJDataBase defined as IPMPJData_BaseClass includes information 
for using IPMP tool(s). The information is necessary to detect digital 
wartermarks and to decode content Such information is managed in register of 
the IPMP system and is retrieved when processing the content. 
10 IPMP_Data_BaseClass is described in predetermined syntax as shown 

in "Syntax" of "IPMP_Data_BaseClass" below. In order to achieve a 

flexible and interoperable IPMP system structure for MPEG-n and other 
applications as described above, we should be able to allow the followings. 
1 . Fix the syntax of various commonly used IPMP data, that includes: 
15 a. IPMP opaque data; 

b. IPMP decryption configuration data; 

c. IPMP audio watermarking configuration data; 

d. IPMP video watermarking configuration data; and 

e. IPMP key stream. 

20 2. Fix the position of where the IPMP data should be carried in the MPEG-n 
content which is protected by IPMP. 

Only when all above are fixed, the interoperable IPMP system for MPEG- 
n can be fully achieved. 

Detailed explanations on items a to e will be described later. 
25 Fig. 3 illustrates the places to carry IPMP data in MPEG-2 IPMP conent. 



3.1 is the place in IPMP stream, where IPMP data can be carried in 
IPMP_info_message which will then form the IPMP elementary stream. 
IPMP_KeyData can be carried in this place. 3.2 is the place in IPMP Descriptor 
which is subsequently carried in IPMP Control Graph Descriptor in PSI., tool 
initialisation data can be carried in this place. 

IPMP Data is carried in the IPMP protected content bitstream (MPEG-2, 
4, 7, 21). The base class is defined as IPMP_DataJ3aseClass. 

IPMP data that are all extended from IPMP_DataJ3aseClass include: 

the IPMP_AudioWatermarkinglnit; 

IPMP_SelectiveDecryptionMessage; 

I P M P_Vi deoWatermarki ng I nit; 

IPMP_KeyData; and 

IPMPJDpaqueData. 

IPMP_Data_BaseClass 
Syntax 

Aligned(8) expandable(2 28 -i)dass IPMP_Data_BaseClass{ 
bit(8) Version; 
bit(8) IPMPJDataTag; 

} 

Semantics 

Version indicates the version of syntax used in the IPMP Data and shall 
be set to 0x01. 

IPMPJDataTag indicates the tag for the extended IPMP data. The exact 
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values for the extension tags are defined in the following table. 



Table 1- Tags for messages extending IPMP_ToolMessageBase 



8-bit Tag Value 


Symbolic Name 


0x00 


Forbidden 


0x01 


IPMP_OpaqueData_tag 


0x02 


IPMP_SelectiveDecryptionMessage_tag 


0x03 


IPMP_AudioWatermarkinglnit_tag 


0x04 


IPMP VideoWatermarkinglnit tag 


0x05 


IPMP_KeyData_tag 
<-> IPMP RightsData tag 


0x06 - OxCF 


ISO Reserved 


OxDO - OxFE 


User Defined 


OxFF 


Forbidden 



Places to carry IPMP Data extended from IPMP_Data_BaseClass 
5 IPMP Data extending from IPMPJData_BaseClass could be carried in 

the following two places: 

- IPMP_Descriptor class (MPEG-2 system) 

- IPMP_info_message class which is subsequently carried in IPMP Stream. 
(MPEG-2 system) 

1 0 - IPMP_Tooi_Descriptor class (MPEG-4 system) 

- IPMPJnitialize which is subsequently carried in IPMP_Tool_Descriptor 
class (MPEG-4 system) 

- IPMP_StreamDataUpdate which is subsequently carried in IPMP Stream. 
* (MPEG-4 system). 

15 In MPEG-2 system case, the IPMP_Descriptor and IPMP_info_message 

need modifications as below: 
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IPMP_Descriptor 

The new syntax for this should be: 



Table 2 - IPMP Descriptor 



Syntax 


No. of bits 


Mnemonic 


0 


IPMP_descriptor() { 








descriptor_tag 


8 


Uimsbf 




descriptor Jength 


8 


Uimsbf 




IPMP DescriptorlD 


8 


Uimsbf 




IPMPJToollD 


128 


Uimsbf 




numControlPoints 


8 


uimsbf 




for ( i=0; i<numControlPoints; 






i++){ 










controlPoint 


8 


uimsbf 




sequenceCode 


8 


uimsbf 




IPMP_Data_length 


16 


uimsbf 




for ( i=0; i< N; 






i++){ 








IPMP Data 


} 


} 


} 







where the IPMP Data is the IPMP Data extended from IPMP_Data_BaseClass. 



5 IPMP_StreamDataUpdate 

The IPMP Stream should be a concatenation of IPMP Stream Data 
Update, with the new syntax defined below. 
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table 3 IPMP_StreamDataUpdate 



Syntax 


No. of bits 


Mnemon 
ip 


lPMP_info_message() { 






IPMP_descriptor_id 


8 


uimsbf 


controLpdint 


8 


uimsbf 


length of message 


16 


uimsbf 


IPMP_bataJength 


16 


uimsbf 


for ( i=0; i<N; { 






IPMP data 


8 


uimsbf 


} 

> 







where the IPMFMData is the IPMP Data extended from IPMP_Data_BaseClass. 

IPMP_StreamDataUpdate has a destination address indicating which tool 
the IPMP data should be sent to. 

Types of IPMP Data that extends from IPMP_Data_BaseClass 
Opaque Data 

Opaque Data can contain various infromatioh depending on respective 
users, cases and so on. 

There are many cases where opaque data may be needed for certain 
tools. Hence IPMP_OpaqueData_tag = 0x01 is reserved for carriage of opaque 
data. The syntax is illustrated below, 

class IPMP^OpaqueData extends IPMP_Data_BaseClass 

: bit(8) tag = IPMP_OpaqueData_tag 

{ 

ByteArray opaqueData; 

} 
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Selective Decryption Configuration Message 

Selective Decryption Configuration Message specifies portions in the 
IPMP Stream, where the stream is encrypted; 
5 The class IPMP_SelectiveDecryptionMessage should now be extended 

from IPMP_Data_BaseClass instead of IPMPJTooIMessageBase. The tag for 
this class should be IPMP_SelectiveDeayptionMessage_Tag as defined in the 
above table for IPMP_Data_BaseClass tags. 

10 Audio Watermarking Configuration Message 

Audio Watermarking Configuration Message specifies an initial value to 
detect watermarks added oh an audio stream, 

The class IPMP_AudidWatermarkihglnit should now be extended from 
IPMP_Data_BaseClass instead of IPMP_TbolMessageBase. The tag for this 
15 class should be IPMP^AudioWatermarkihglnit_Tag as defined in the above 
table for IPMP_Data_BaseClass tags. 

See "MPEG -2 IPMP", ISO/IEC 13818-1:2000 PDAM2, March, 2002, 
and "MPEG -4 IPMP Extension", FPDAM ISO/IEC 14496-1:2001 / AMD3, 
20 March, 2002. 

IPMP Key Data 

The IPMP_KeyData is defined to extend from IPMPJData_BaseClass. 
This IPMP data could possibly be carried iri IPMPJnfd_message which is 
25 subsequently carried in IPMP Stream. This facilitates the time variant key 
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carried in IPMP Stream. 



Syntax 

class IPMP_KeyData extends IPMP_Data_BaseClass : 
5 bit(8) tag = IPMP_KeyData_Jag 

{ 

ByteArray keyBody; 
bit(1) isTimeScheduled; 
const bit(7) reserved = ObOOOOOO; 
10 if (isTimeScheduled) 

{ 

bit(33) PTS; 

const bit(7) reserved = ObOOOOOO; 

} 

1 5 ByteArray OpaqueData; 

} 

Semantics 

keyBody - the body of the key. The value shall be data that conforms to 
20 a rule for data structure of the key defined outside of this document. 

IsTimeScheduled - Specify if the key is scheduled to be active at a 
certain PTS value. If this value is set to 1, there should be a PTS value followed 
indicating the activation time. 

OpaqueData - Any other opaque data carried in this IPMP data, 
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Video Watermarking Configuration Message 

Video Watermarking Configuration Message specifies an initial value to 
detect watermarks added on a video stream. IPMP_VideoWatermarkinglnit 
data is used to intialise a Watermarking Tool about the process of 
5 insertion/extraction of the watermarking payload into/from a video stream. 

Syntax 

class IPMP_VideoWatermarkinglnit extends IPMP_Data_BaseClass : 
bit(8) tag = IPMP_VideoWatermarkinglnit_tag 

10 { 

bit(8) inputFormat; 
' bit(4) requiredOp; 
bit(1 ) hasOpaqueData; 
const bit(3) reserved = ObOOO; 

15 

if (inputFormat == YUV) 
{ 

bit(16) frame_hdrizbntal_size; 
bit(16) frame_vertical_size; 
20 bit(8) chroma_format; 

} 
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if ((requiredOp == INSERT_WM)||(requiredOp == REMARK_WM)) 
{ 

bit(16) wmPayloadLen; 
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bit(8) wmPayload[wmPayl6adLen]; 

} 

if ((requiredOp == EXTRACT JAWI)) 
{ 

bit(16) wmRecipientld; 

> 

if (hasOpaqueDatai) 
{ 

bit(16) opaqueDataSize; 

bit(8) opaqueDatai[bpaqueDataSize]; 

} 

} * 

Semantics 

The IPMP_videdWatermarkingjlnit data delivers to a watermarking tool all 
the information about the characteristics of the video content, the type of action 
to be performed on it and, possibly other related proprietary data required by 
the watermarking tool. Furthermore in case of: 

- ihsertidh, the watermarking payload to be inserted; 

^ extfaction i the ID of the recipient of the watermarking payload is 
provided; 

- remarking, the watermarking payload to be inserted. 
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• inputFormat: The format of the video input stream, as indicated in a 
Table to be maintained by a registration authority, The Table shall contain at 
least all video formats indicated in Table 8 "ObjectTypelndicatidn values" in [3] 

• RequiredOp: the operation that the Watermarking tool is required to 
5 perform on the audio stream. The following values are allowed: INSERT_WM = 

0EXTRACT_WM=1 REMARKJ/VM =2lSO reserved = 3..10User defined = 
11. .15 

• frame_hbrizontaLsize: Horizontal size of the yuv frame 

• frame^vertical_size: vertical size of the yuv frame 

10 ■ chroma Jbrmat: chroma_format: 0x01=4:2:0, 0x02=4:2:2, 0x03=4:4:4, 

ISO reserved =0x04.. OxAO, User defined = 0xA1..0xFE, Forbidden: 0x00, OxFF 

• WmPayloadLen: the length of the watermarking payload in bytes to 
be inserted in the video content. 

• WmPayload: the watermarking payload to be inserted in the video 
1 5 content 

• WmRecipientld: the address of the destination tool, to which the 
watermarking payload and compression information must be delivered. 

• HasOpaqueData: a flag that indicates if the message also carries 
opaque data information for the watermarking tool. 

20 • OpaqueDataSize: the length of th6 opaque data field in bytes 

• OpaqueData: the opaque data field carrying proprietary 
information to the watermarking tool (e.g. initialisation parameters, like specific 
algorithm id, keys, etc. ) 

25 IPMP_SehdVideoWaterrtiafk Message 
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The Watermarking Tool receives the video stream and in case of 
watermarking extraction, replies with an IPMP_SendVideoWatermark message 
carrying the watermarking payload. 

5 Syntax 

class IPMP_SendVideoWatermark extends IPMP_ToolMessageBase : 
bit(8) tag = IPMP_SendVideoWatermarkJag 

{ 

bit(4) wm_status; 
10 bit(1) hasOpaqueData; 

bit(3) reserved = ObOOO; 

if (wm_status == WM_PAYLOAD) 

{ 

ByteArray payload; 

15 } 

if (hasOpaqueData) 

{ 

ByteArray opaqueData; 

} 

20 } 

Semantics 

A watermarking tool, which has been required to perform payload 
extraction by means of an IPMP_VideoWatermarkihglnit will send this message 
25 to wmRecipieritld each time a new watermarking payload is extracted from the 
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videocdntent. 

• wm_status: the result of the check if watermarking was present. 
If watermark was detected, then this value also says if the payload extracted is 

5 carried inside the message or not. Possible values are listed in the wrrt_status 
table below. 

• hasOpaqueData: a flag indicating whether this message carries 
opaque data, 

• payload: the watermarking payload extracted from the video 
1 0 content. 

• dpaqueData: opaque data from the Watermarking tool. 
wm_status table 

• WM_PAYLOAD: Watermarking was present in the video stream, 
1 5 payload is carried in the message. 

• WM_NOPAYLOAD: Watermarking was present in the video stream, no 
I payload is carried in the message. 

• NO_WM: Watermarking was not present in the video stream. 

• WM_UNKNOWN: The Watermarking Tool was unable to detect 
20 whether watermarking was present in the video stream or hot. 

Refering how to Fig, 3, adaptation of the information contained in 
IPMPJDataBase is described next. Fig. 3 shows flows of information in a 
server which provides a terminal with a IPMP protected content. In this Figure, 
25/ Program Specific Information ("PSI") and "IPMP Protected MPEG-2 Content" 
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are finally obtained arid provided for Vt\& terminal: PSI describes, for example, 
one or more types of scrambling scheme and existence of wartefmarks. One 
PSI may be created for each content* or for a plurality of content. 

IPMP_OpaqueData is set in IPMP Control Information in PSI. 
5 The three types of information " IPMP_SelectiveDecryptiohMessage n , 

, 1PMP_AudibWatermarkihglhit n , and 'IPMP^VideoWatermarkinglnit" are defined 
in IPMPJnfo, where IPMP data is carried. The above three types of information 
are incorporated in IPMP_Control_Graph and then set in Program Map Table 
(PMT). 

10 "IPMP^KeyData" forms a part of IPMP information, which contains data 

on one or more keys for descrambling the content. "IPMP_KeyData" may be 
varied dependent on time. A headeer is added to IPMP information to be 
incorporated in "IPMP Stream" in the Content Stream, where IPMP data is 
carried. 

15 Based on the IPMP_DataJ3aseClass, some useful IPMP data syntax 

were clearly defined. Suppose the content's video stream is encrypted by IPMP 
AES tool A, the content author can clearly define an AES tool initialisation 
information using IPMP_SelectiveDecryptionMessage extending from 
IPMP_Data_BaseClass. The initialization information may include block size, 

20 encryption method. The entire IPMP_Se(ectiveDecryptionMessage can be 
carried in IPMP Descriptor (in MPEG-2 IPMP case) or IPMP_T6oi_Descriptof 
(in MPEG-4 IPMP case), as illustrated by 4.1 in Fig, 4. 

The video stream may be encrypted by a time variant key stream. In this 
case, the content author constructs IPMP_KeyData extending from 

25 IPMP_Data_BaseClass which includes the time variant key. The 
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IPMP_Keybata is carried in IPMP Stream, as illustrated by 4.2 in Fig. A. 

The AES tool vendor can then conform to the same standard, and 
develop a AES Decryption tool A (as illustrated in Fig. 4) that can understand 
the IPMP_$eiectiveDecrYptidnMess coming from IPMP_Descriptof or 
5 IPMPJTool_Descriptdf in the content stream. 

Suppose the content's video stream is watermarked by IPMP Video 
Watermarking tool B, the content author can clearly define a video 
watermarking tool initialisation information using lPMP_VidedWatermarkinglnit 
extending from IPMP_Data_BaseClass. The initialization information may 
10 include chroma format* frame size, watermark payload to be inserted, whether 
to insert or extract Watermark, etc. The entire iPMP_VidedWatermarkinglnit can 
be carried in IPMP Descriptor (in MPEG-2 IPMP case) or 
IPMP_Tddl_Descriptor (in MPEG-4 IPMP case), as illustrated by 4.3 in Fig. 4, 

The video watermarking tool vendor can then conform to the same 
15 standard, arid develop a video watermark tool B (as illustrated in Fig. 4) that can 
understand the IPMP_VideoWatermarkihglnit coming from IPMP_Descriptor or 
IPMP_Tddl_Descriptdr in the content stream. 

At the terminal side, when the terminal receives the content stream, it 
retrieves the IPMP Descriptor from IPMP Control Graph in MPEG-2's PSI. The 
20 IPMP Descriptor containing the IPMP_SelectiveDeciyptidnMess is 
deiievered to the AES decryption tool A as illustrated by 4.4 in Fig, 4. AES 
decryption tool receives this IPMP data^ parses it according to the defined 
syntax, and configures itself. 

The; IPMP Descriptor containing the IPMP_VideoWatermarkihglnit is 
25 deiievered to the video watermarking tool B as illustrated by 4.5 in Fig. 4. Video 
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watermarking tool & receives this IPMP data, parses it according to the defined 
syntax* and configures itself. . 

When the content flows it, the MPEd-2 terminal's demultiplexer retrieves 
IPMP data which contains the time variant key from IPMP stream. It delivers 
5 this IPMP Data td AES decryption tool A as illustrated by 4.6 in Fig. 4. Tool A 
receives this IPMP_K§yData, and uses the new time variant key to decrypt the 
video elementary stream. 

The video watermarking tool receives the video stream and in case of 
watermarking extraction, replies with an IPMP_SendVideoWaterrtiark message 
10 carrying the watermarking payload as illustrated by 4.7 in Fig, 4. 

With the above mentioned embodiment, by constructing a data base 
which contains information to be used to inform the MPEG-2 IPMP terminal 
what kind of content protection tool is used, what kind of watermarking tool is 
used, or what kind of encryption key is used, the interoperability between the 
15 protected-conterit provided and this receiver can be realized and any MPEG-ri 
IPMP terminal can decrypt the contents sent from a content provider together 
with the IPMP stream or IPMP control informatibh or IPMP control graph. 



CLAIMS 



1 . A method of using IPMP Data in IPMP system, at the content author side, 
comprising: 

Constructing a database which contains information to be used for IPMP 
tool required to process and protect content; 

Creating an IPMP data from the information contained in the database; 
Adding the IPMP data to the content to creat IPMP Protected content. 

2. The Method of using IPMP Data in IPMP system according to claim 1, at 
the content author side, 

wherein the IPMP data is constructed by extracting information from the 
database based on a defined IPMP data syntax. 

3. The Method of using IPMP Data in IPMP system according to claim 2, at 
the content author side, further comprising carrying the IPMP data in IPMP 
Descriptor in IPMP Control Graph, which is subsequently carried in PSL 

4. The Method of using IPMP Data in IPMP system according to claim 2, at 
the content author side, wherein the IPMP data is wrapped in 
IPMP_StreamDataUpdate which has a destination address indicating which tool 
the IPMP data should be sent to. 

5. The Method of using IPMP Data in IPMP system according to claim 1, 
wherein the IPMP Protected content is MPEG-2 content. 

6. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-4 content, and 

wherein the method further comprises Carrying the IPMP data in 
IPMP_TooLDescriptor in OD stream. 
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7. The Method of using IPMP Data in IPMP system according to claim 2, 
Wherein the IPMP Protected content is MPEG-4 content, and 

wherein the method further comprises Carrying the IPMP data in 
IPMPJnitialize which is subsequently carried in IPMP_Todl_Descriptor in OD 
stream. 

8. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the; IPMP Protected content is MPEG-4 content* aihd 

wherein the method further comprises Carrying the IPMP data in IPMP 
Stream, which is wrapped in IPMP_StreamDataUpdate which has a destination 
address indicating which tool the IPMP data should be sent to, 

9. The Method of using IPMP Data in IPMP system according to claim 2, 
wherein the IPMP Protected content is MPEG-ri content, and 

wherein the method further comprises Carrying the IPMP data in defined 
position in the MPEG-ri IPMP content stream. 

10. A Method of using IPMP Data in IPMP system, at the IPMP terminal side* 
comprising: 

Extracting IPMP Descriptor containing IPMP data from IPMP Protected 
content; and 

Delivering IPMP Descriptor containing the IPMP data to a IPMP tool 
which is also indicated in iPMP Descriptor by the means of IPMP Tool ID, 

wherein the IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, arid act upon it. 

11. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 1 0, further comprising: 

Demultiplexing the IPMP Stream containing the: IPMP data from the 



IPMP Protected content; and 

Delivering each IPMP_StreamDataUpdate containing the IPMP data to 
the IPMP tool Whose address is indicated in the above mentioned 
IPMP_StreamDataUpdate, 

wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

12. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10, wherein the IPMP Protected content is MPEG-2 content. 

13. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 12, further comprising: 

Extracts the IPMP_TooLDescripfor containing the IPMP data from the 
IPMP Protected content; and 

Delivering the IPMP_Tdol_Descript6r containing the IPMP data to the 
IPMP tool which is also indicated in IPMP_Tool_Descriptof by the means of 
IPMP Tool ID in IPMP_TooLDescriptdr, 

wherein the IPMP tool, upon receiving of such a IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

14. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 1 0, 

wherein the IPMP Protected content is MPEG-4 content, 
wherein the method further comprises: 

Extracts the IPMPMnitialize containing the IPMP data from the 
IPMP_Tool_Descriptor from the IPMP Protected content; 

Delivering the I P M P_Tbb ^Descriptor containing the above mentioned 
IPMPJnitialize which subsequently carries IPMP data to the IPMP tool which is 
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also indicated by the means of IPMP tool ID in IPMP_T6oLDescriptor, 

wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

15. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 1 0, 

wherein the IPMP Protected content is MPEG-4 content, 
wherein the method further comprises: 

Extracts the IPMP_StreamDataUpdate containing the IPMP data from the 
IPMP Stream from the IPMP Protected content; 

Delivering the IPMP_StreamDataUpdate containing the above mentioned 
IPMP data to the specific tool which is also indicated in 
IPMP_StreamDataUpdate by the means of !PMP_ToolDescriptorlD, and 

wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, and act upon it. 

16. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
according to claim 10, 

wherein the IPMP Protected content is MPEG-n content, 
wherein the method further comprises: 

Extracting the IPMP Data from the defined position in the IPMP Protected 
content; and 

Delivering the IPMP Data to the IPMP tool which is also indicated by the 
means of IPMP tool ID associated with the IPMP Data, 

wherein the IPMP tool, upon receiving of such an IPMP Data, interprets it 
according to the specific IPMP data syntax, arid act upon it, 

17. A Method of using IPMP Data in IPMP system, at the IPMP terminal side, 
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according to claim 10, 

wherein the IPMP Protected content is MPEG-n content, 
wherein the method further comprises: 

Extracting the IPMP video watermarking initialization data from the 
5 defined position in the IPMP Protected content; arid 

Delivering the IPMP video watermarking initialization data to the specific 
video watermarking tool which is also indicated by the means of IPMP Tool ID 
associated with the IPMP Data, 

wherein the IPMP video watermarking tool, upon receiving of such an 
10 IPMP Data, interprets it according to the specific IPMP data syntax, and act 
upon it, and 

wherein the IPMP video watermarking tool, when detecting a watermark 
from the video stream, notifies the terminal using IPMP_SendVideoWatermark 
message. 
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ABSTRACT 

MPEG-n IPMP system with a wide interoperability is provided. For this 
purpose, the IPMP_Data_J3aseClass is defined, several IPMP data extending 
5 from this base class are also defined. IPMP data is the data that describes IPMP 
information, it includes: IPMP_OpaqueData; IPMP_SelectiveDecryptionMessage; 
IPMP_AudioWatermarkinglnit; IPMP_VideoWatermarkinglnit; and IPMP__KeyData. 
Places where IPMP data extending from IPMP_Data_J3aseClass are also 
specified. With the above work, a IPMP tool from Vendor A will be able to 
10 understand the IPMP data constructed by Content Author B, hence the inter- 
operability will be achieved, that is, the same protected content will be able to be 
consumed on different vendor's MPEG-n IPMP terminals. 
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